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1 Introduction 

The experiments with solar, atmospheric, reactor and accelerator neutrinos [1-12] have pro- 
vided compelling evidences for the existence of flavour neutrino oscillations [13, 14] caused by 
nonzero neutrino masses and neutrino mixing. The data imply the presence of neutrino mixing in 
the weak charged lepton current: 

= ^^UljVji,{x), l = e,ix,T, (1.1) 

3 

where vn^ are the flavour neutrino fields, Vj\,{x) is the left-handed (LH) component of the field of 
the neutrino Vj possessing a mass mj and J7 is a unitary matrix - the Pontecorvo-Maki-Nakagawa- 
Sakata (PMNS) neutrino mixing matrix [13-15]. 

All compelling neutrino oscillation data can be described assuming 3-flavour neutrino mixing 
in vacuum. The data on the invisible decay width of the Z^-boson is compatible with only 3 light 
flavour neutrinos coupled to (see, e.g. [16]). The number of massive neutrinos Vj^ n, can, in 
general, be greater than 3, n > 3, if, for instance, there exist right-handed (RH) sterile neutrinos 
[15] and they mix with the LH flavour neutrinos. It follows from the existing data that at least 3 
of the neutrinos z^j, say z^i, 1^2; J^Sj must be light, ?7t-i^2,3 ^ 1 eV, and must have different masses, 
mi ^ mi ^ m3. At present there are no compelling experimental evidences for the existence of 
more than 3 light neutrinos. 
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Being electrically neutral, the massive neutrinos Vj can be Dirac fermions (possessing distinctive 
antiparticles) , or Majorana particles (which are identical with their respective antiparticles, see, 
e.g., [17]). On the basis of the existing neutrino data it is impossible to determine whether the 
massive neutrinos are Dirac or Majorana fermions. 

In the case of 3 light neutrinos, the neutrino mixing matrix U can be parametrized by 3 angles 
and, depending on whether the massive neutrinos Uj are Dirac or Majorana particles, by 1 or 3 CP 
violation (CPV) phases [18]: 



/ C12C13 S12C13 Sl3e"*'^\ 

C^PMNS = -S12C23 - Cl2S23Sl3e*'^ C12C23 - 512523^136*'^ S23C13 

\ S12S23 - Cl2C23Sl3e*^ -C12S23 - Sl2C23Sl3e*'' C23C13 / 



diag(l,e*^,e*^) (1.2) 



where Cij = cosOij, Sij = sin^jj, 6ij = [0,7r/2], 6 = [0,27r] is the Dirac CP-violation (CPV) 
phase and a2i)CK3i are two Majorana CPV phases ^. If one identifies Am'^i > and Am|^ (or 
Am^g) with the neutrino mass squared differences which drive the solar and atmospheric neutrino 
oscillations, 612 and ^23 represent the solar and atmospheric neutrino mixing angles, while ^13 is 
the CHOOZ angle [23]. The existing oscillation data allow us to determine Am2i = Attiq, 612, 
and [Arngj^l = [Am^jj^^l, 623, with a relatively good precision [24-26], and to obtain rather stringent 
limits on the angle ^13 [23]. The best fit values and the 99.73% C.L. allowed ranges of Am^i, 
sin^0i2, I Am2j^j.22) I and sin^ ^23; read [26]: 

Am^i = 7.59l[]:?^ X 10"^ eV 2, Am|i = (7.03 - 8.27) x 10"^ eV ^ , (1.3) 

sin^ 6*12 = 0.318;[}:[jJ^, 0.27 < sin^ 6*12 < 0.38 , (1.4) 

[Amiil = 2.40l[j:J? X 10"^ eV ^, [Am^J = (2.07 - 2.75) x lO'^ eV ^ , (1.5) 

sin^ 6*23 = 0.5to^l, 0.36 < sin^ 6^23 < 0.67 . (1.6) 

Thus, we have \Aml^2)\ » Am^^, Aml^/\Amli\ = 0.03, and lAml;^! = |Am32 - Am2i| = 
|Am32|. Maximal solar neutrino mixing, i.e. 612 = vr/4, is ruled out at more than 6a by the data. 
Correspondingly, one has cos20i2 > 0.26 (at 99.73% C.L.). A combined 3-neutrino oscillation 
analysis of the global data gives [27]: 

sin2ei3 < 0.031 (0.047) at 90% (99.73%) C.L. (1.7) 

The results of the global analyzes include also a weak indication of nonzero sin^ ^13 ~ 0.01 (for 
a review see [27]). If ^13 7^ 0, the Dirac phase 5 can generate CP violation effects in neutrino 
oscillations [18, 28, 29]. The size of the indicated leptonic CP violation effects depends on the 
magnitude of the currently unknown values of ^13 and 6 [30] . 



^The two Majorana CP-violation phases [18] do not enter into the expressions for the oscillation probabilities of 
interest [18, 19] and we are not going to discuss them further. They play important role in the phenomenology of 
neutrinoless double beta decay (see, e.g., [20]). The phases 021,31 can affect significantly the predictions for the rates 
of the (LFV) decays /i— >-e-|-7, r— + etc. in a large class of supersymmetric theories incorporating the see-saw 
mechanism [21]. The Majorana phases can provide the CP violation, necessary for the generation of the baryon 
asymmetry of the Universe in the leptogenesis scenario of the asymmetry origins. [22]. 
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The existing data do not allow us to determine the sign of The two possibilities, 

Am^^^2) > or Am^-^^^^^) < Oi ^ is well known, correspond to two different types of neutrino mass 
spectrum: with normal ordering (hierarchy (NO,NH)), nii < ?Ti2 < 7713, and with inverted ordering 
(hierarchy (IO,IH)), < mi < m2- 

Determining the nature - Dirac or Major ana, of massive neutrinos, getting more precise infor- 
mation about the value of the mixing angle ^13, determining the sign of Am^i, or the type of the 
neutrino mass spectrum (with normal or inverted ordering (hierarchy) ^) and getting information 
about the status of the CP symmetry in the lepton sector are among the major and remarkably 
challenging goals of future studies in neutrino physics (see, e.g., [27, 31, 32]). Establishing whether 
the neutrino mass spectrum is with normal or inverted hierarchy, i.e., measuring the sign of Arn^i 
and determining the nature of massive neutrinos, in particular, are of fundamental importance for 
understanding the origin of neutrino masses and mixing (see, e.g., [33]). 

In the present article we continue the studies of the possibility to obtain information about 
the type of spectrum the light neutrino masses obey (i.e., about sgn(Am|]^)) in experiments with 
reactor antineutrinos. This possibility was discussed first in [34] and later was further investigated 
in [35-38]. It is based on the observation that for cos 2^12 7^ and sin0i3 7^ 0, the probabilities of i>e 
survival in the cases of NO (NH) and 10 (IH) spectra differ [34, 39]: P^^{i?e ^ z^e) / P^"{i^e ^ i^e)- 
For sufficiently large | cos 2^12 1 and sin^ ^13 and a baseline of several tens of kilometers, this difference 
in the z^e oscillations leads, in principle, to an observable difference in the deformations of the 
spectrum of e"*" [34], produced in the inverse beta-decay reaction + p — ?• e"*" + ?i by which 
the reactor z/g are detected. In [35] the physics potential of a reactor neutrino experiment with 
a relatively large detector at a distance of several tens of kilometers has been analyzed in detail. 
More specifically, the strategies and the experimental set-up, which would permit to measure Am^i 
and sin^ 012 with a high precision, get information on (or even measure) sin^0i3, and if sin^ ^13 is 
sufficiently large (sin^ ^13 ^ 0.02) provide a high precision measurement of Arn^^^ and determine 
the type of the neutrino mass hierarchy, have been discussed. The impact that i) the choice of the 
baseline L, ii) the effect of using a relatively low e^— energy cut-off of Eth ~ 1.0 MeV, iii) the 
detector's energy resolution, as well as iv) the statistical and systematical errors, can have on the 
measurement of each of the indicated neutrino oscillation parameters and on the determination of 
the neutrino mass hierarchy have also been investigated in [35] . 

In [36] a Fourier analysis of reactor i^g simulated data using the exponential Fourier transform 
(FT) was performed. It was found that the NH and IH neutrino mass spectra are distinguished by a 
relatively small shoulder beside the -^"i^tm modulation peak, which for the NH (IH) spectrum is to 
the left (to the right) of the peak. In the same study results of a statistical analysis of the possibility 
to determine the neutrino mass hierarchy for different baselines, different values of ^13 and different 
detector exposures (statistics) were also presented. In that analysis the effects of the detector 
energy resolution were accounted for, but the systematic uncertainties and the uncertainties in the 

^We use here and in what foUows the generic terms "normal hierarchical" and "inverted hierarchical" for the 
neutrino mass spectra with normal ordering and inverted ordering, i.e., the spectra need not necessarily be hierarchical. 
We will use also the widely accepted term "neutrino mass hierarchy" for sgn(Am^tm) (i-e-, for the neutrino mass 
ordering) . 
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energy scale and the neutrino oscillation parameters were not taken into account. The latter were 
included in an unbinned maximum likelihood analysis performed in [37]. 

It was noticed in [38] that the sine and cosine Fourier transforms of simulated reactor Vf. data 
in the case of NH and IH spectrum show a difference in certain specific features which can be used 
to distinguish between the two types of spectrum. The authors of [38] include in their numerical 
simulations the effects of the detector's energy resolution and an uncertainty in the energy scale 
(shift and shrink/expansion), which is independent of energy. They do a statistical hierarchy 
analysis similar to that performed in [36] and give results for different values of ^13, of the energy 
resolution and exposures. No systematic uncertainties or parameter marginalization were taken 
into account in this investigation. The possibility of an energy-dependent energy scale uncertainty 
was not considered either. 

The present article is a natural continuation of the studies performed in [34-38]. More specif- 
ically, we investigate further the behaviour of the sine and cosine Fourier transformed e"*" spectra 
taking into account, in particular, the possibility of an energy-dependent energy scale uncertainty 
(assuming the shrink/expansion factor to have a linear dependence on the neutrino energy). In 
general, the mass hierarchy-dependent features of the Fourier spectra of interest are changed in 
the case of an energy-dependent energy scale shift. This might affect a statistical analysis using 
the FT method. We perform also a analysis of the sensitivity to the neutrino mass hierarchy 
using simulated reactor Vf, data. In this analysis we take into account a marginalization over the 
relevant neutrino oscillation parameters, the detector resolution, the energy scale uncertainty (both 
energy-dependent and independent) and the systematic errors. A analysis offers the advantage 
of a binned study in which the binning (the division of the L/E range into bins) is optimized on 
the basis of the energy resolution and the improvement in sensitivity so as to give the best possible 
sensitivity to the neutrino mass hierarchy while being consistent with the detector's energy resolu- 
tion. The systematic uncertainties are included using the method of pulls. We present results, in 
particular, for different values of the detector's energy resolution, exposure and ^13. 

Let us note that the type of neutrino mass hierarchy, i.e. sgn(Am|]^), can be determined by 
studying oscillations of neutrinos and antineutrinos, say, -f-)- v^. and v^^ v^^ in which matter 
effects are sufficiently large. This can be done in long base-line i/-oscillation experiments (see, e.g. 
[32, 40]). If sin^ 2^13 ^ 0.05 and sin^ ^23 ^ 0.50, information on sgn(Am3^) might be obtained in 
atmospheric neutrino experiments by investigating the matter effects in the subdominant transitions 
f^(e) — )• fe(/i) and ^'^(e) — )■ of atmospheric neutrinos which traverse the Earth [41, 42], or by 
studying the "disappearance" of the atmospheric i^^ and crossing the Earth [42, 43]. For v^J^(e) 
{or ^'^(e)) crossing the Earth core, a new type of resonance-like enhancement of the indicated 
transitions takes place due to the (Earth) mantle-core constructive interference effect (neutrino 
oscillation length resonance (NOLR)) [44]^. For A?n|]^ > 0, the neutrino transitions i^^(e) ~^ ^e{p) 
are enhanced, while for Am|^ < the enhancement of antineutrino transitions i^^(e) — ^ ^e(/x) takes 

■^As a consequence of this effect the indicated t',i(e) {or i5p(e)) transition probabilities can be maximal [45] (for the 
precise conditions of the mantle-core (NOLR) enhancement see [44, 45]). Let us note that the Earth mantle-core 
(NOLR) enhancement of neutrino transitions differs [44] from the MSW one. 



-4- 



place, which might allow to determine sgn(Am3^). If neutrinos with definite mass are Majorana 
particles, information about the sgn(A?7i3^) could be obtained also by measuring the effective 
neutrino Majorana mass in neutrinoless double /3— decay experiments [20, 46]. Information on the 
type of neutrino mass spectrum can also be obtained in /3-decay experiments having a sensitivity 
to neutrino masses ~ y|Am|jJ = 5 x 10~^ eV [47] (i.e. by a factor of ~ 4 better sensitivity than 
that of the KATRIN experiment [48]). 



2 Preliminary remarks 

We consider an experimental set-up with a nuclear reactor producing electron antineutrinos by the 
/3-decay of fission products of the isotopes U-235, U-238, Pu-239 and Pu-241. The Ve are assumed 
to be detected in a single KamLAND-like [9] liquid scintillator detector, located at a distance of 60 
Km from the reactor, by the inverse /3-decay reaction: 



i^e +P — > e"*" + n . (2.1) 
The visible energy of the detected positron is given by 

Ems = E + me- (m„ - nip) (2.2) 
~ - 0.8 MeV (2.3) 

Here me-,mn and rup are the masses of the positron, neutron and proton, respectively, and E is 
the Ve energy. The no-oscillation event rate spectrum is the product of the initial flux spectrum 
and the inverse /3-decay cross-section and is bell-shaped, with its peak at about E^s = 2.8 MeV. 
In the present analysis we use the analytic expression for the v^, flux spectrum given in [49]. The 
latter has a fit error of about 1.2% on the total event rate. The expression for the v^+p ^ + n 
cross-section is taken from [50]. The threshold of the visible energy used is Eyist^ = 1.0 MeV (see 
further). 

The event rate spectrum is given by the product of the no-oscillation spectrum and the z^e 
survival probability Pgg- In the convention we are using the expression for the survival probability 
in the case of 3 flavor neutrino mixing and NH(IH) neutrino mass spectrum is given by'^ [34, 39]: 

P (D ^ D ^ - P^H(^H) 

^NH{IH)V^e ^e) = -Tge 

= 1-2 sin2 cos2 013 (^1 - COS ^""Ye"^ ^ 

1a of Am%L\ , , 

- - cos^ 6*13 sin^ 20x2 1 - cos ^ % (2.4) 



2 " V 2E 



2 .;.2. 2. /_/^^"^atm^ Am|L\ Am^^^L^ 



+ '^<^NH{IH) Sin^ ^13 COS^ 013 COS ^ 



cos ■ 



2E / 2E 



''The Earth matter effects are negligible for the values of the neutrino oscillation parameters (Am2i and Am|i), 
Ue energies and the short baseline L = 60 km we are interested in. 
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where Amg = Am^i and o?^}j(^ifj-^ = sin^ 9x2 (cos^ ^12)- For the atmospheric neutrino mass squared 
difference Am^^^^ in the case of NH (IH) spectrum we have = ^'^ii (^"^23)- The 

M T-f ( T J-f\ 

properties of the 9^ survival probabihty Pgg have been discussed in detail in [34, 35]. We only 
note here that P^^^^^^ depends neither on the angle 623 associated with the atmospheric neutrino 
oscillations, nor on the CP violating phase 6 in the PMNS matrix. The fact that cos 2^12 7^ 0, 
cos 2^12 > 0.26 (at 3a), opens up the possibility to get information about the neutrino mass 
spectrum if sin^ 2^13 / 0: Pg^ — P^^^ oc cos 20i2 sin^ 2^13. This can be done, in principle, by 
studying the deformations of the observed event spectrum due to the survival probability [34] . 

The detector energy resolution is taken into account assuming it has the standard Gaussian 
form: 

R{E, E^) = -^exp{-^-^^^^^-^) . (2.5) 

Here Em is the observed neutrino energy. We have Em — E = Eyism — Evis-, where Emsm is 
the measured e"*" energy. The error for a scintillator detector is dominated by the photoelectron 
statistics, and hence a/Ems is proportional to l/V E^s . We consider resolutions (i.e., a/Ems) in 
the range of 2%/\/^E~ - A%/y/E~. 

Further, we take into account the energy scale uncertainty of the detector by considering an 
energy scale shrink/expansion both with and without energy dependence. This is parametrized as 

Em = {l + a)Em + b, (2.6) 

where Em is the neutrino energy after smearing and E'^ is the measured neutrino energy after 
including both the smearing and energy scale uncertainty. The parameters a and b define the 
shrink/expansion and the shift of the energy scale, respectively. The parameter a is taken to be 
1% (unless otherwise specified) for the energy independent case, and 1% of Em (i-e., a = O.OlEm) 
for the energy dependent case^. Rigorously, in the energy dependent case, a could have the form 
a = cEm + d, corresponding to a combination of a non- linear and a linear dependence of E'm on Em ■ 
However, it will be shown later that considering an energy dependent and an energy independent 
scale uncertainty simultaneously in this way (c, d non-zero) has the same effect as considering only 
an energy dependent scale uncertainty (c non-zero, d zero). 

The measured event rate spectrum, as a function of L/Em, is thus given by 

N{L/Em) = j R{E, Em)HE)c7{ueP ^ e+n; E)pg''^'''^ dE , (2.7) 

where (j){E) is the Ve flux spectrum, a{i>eP e'^n; E) is the inverse /3-decay cross-section and 
P~^^^^^ is the Ue survival probability defined earlier. 



^Accounting for the energy scale uncertainty on Evism leads to an additional shift in E„-^ which, however, does not 
have an effect on the spectrum features distinguishing between the NIf and IH neutrino mass spectra (see subsections 
3.1 and 3.2). 
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The final statistics (total number of events) is a product of the event rate, the reactor power, 
the detector active mass and exposure time. The exposure is thus expressed in the unit kT GW yr. 
The KamLAND-like large underwater detector planned within the project Hanohano [63], can have 
a mass of up to ~ 10 kT and use a reactor having a power of ~ 5 GW. Hence we consider exposures 
in the range of 200-800 kT GW yr. A 100% efficiency of the detector is assumed. This gives, for 
example, a statistics of about 10^ events (with oscillations) when an exposure of 200 kT GW yr 
is considered. Because of the high statistics, the geo- neutrino flux background at lower energies 
becomes insignificant [35] and it is possible to use the relatively low visible energy threshold of 
Evisth = 1-0 MeV mentioned earlier. 

In the statistical analysis we take into account the systematic uncertainties relevant to a detec- 
tor of the type assumed by us. We consider 5 sources of systematic errors (3 related to the detector 
and 2 due to the geo-neutrino flux) [36, 37]: 

i) The efficiency error, or the uncertainty in the predicted event rate, which can be between 1 
to 5 %. 

ii) The uncertainty in the detector energy resolution estimation, which can be up to 10 %. 

iii) The energy scale uncertainty, which is around 1 %. 

iv) The uncertainty in the total detectable geo-neutrino flux. 

v) The uncertainty in the ratio of the geo Vf, fluxes from the decays of U-238 and Th-232. 

We find during the course of the study that the effects of the indicated systematic and geo- 
neutrino uncertainties on the neutrino mass hierarchy sensitivity are not significant. 

Finally, we comment on the prospects of high precision determination of the neutrino oscillation 
parameters which serve as input in our analysis. The oscillation parameters Am|]^, sin^ ^12 and 
jAmlj^l are determined by the existing data with a 3(T error of approximately 9%, 17% and 15%, 
respectively. These parameters can (and very likely will) be measured with much higher accuracy in 
the future. The highest precision in the determination of |Am3^| is expected to be achieved in the 
next several years from the studies of i^^-oscillations in the T2K experiment with Super-Kamiokande 
detector (T2K (SK)) [51]: if the true |Am|i| = 2.5 x lO^^ (^^^^ ^^^^ sin^ (923 = 0.5), the 
uncertainty in |Am|]^| is estimated to be reduced in this experiment to 10^'^ eV^ or 4% at 90% C.L. 
[51, 52]. The Fermilab-Homestake beam experiment (LBNE) is expected to reduce this error to 
less than 3% at 90% C.L. [53]. Further, reactor antineutrino experiments themselves may be able 
to provide a determination of |Am|^| with an uncertainty of approximately 1% at la, or (3 — 4)% 
at 3<T [35-37]. In what concerns the CHOOZ angle ^13, three reactor experiments with baselines 
L ~ (1-2) km, which could improve the current limit by a factor of (5-10), are under preparation: 
Double-CHOOZ [54], Daya-Bay [55] and RENO [56] (see also [27]). The most precise measurement 
of Am^i could be achieved [57] using Super-Kamiokande doped with 0.1% of gadolinium (SK-Gd) 
for detection of reactor Uf, [58]: getting the same flux of reactor v^, as KamLAND, the SK-Gd 
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detector will have approximately 43 times bigger i>e-induced event rate than KamLAND. After 3 
years of data-taking with SK-Gd, ^rn^^ could be determined with an error of 3.5% at 3(T [57]. 
A dedicated reactor Vf. experiment with a baseline L ~ 60 km, tuned to the minimum of the 
survival probability, could provide the most precise determination of sin^ Qyi [59] : with statistics of 
~ 60 kT GW yr and systematic error of 2% (5%), sin^ Q\2 could be measured with an error of 6% 
(9%) at'' 3cT [59]. 



3 The effects of energy smearing and energy scale uncertainty on the reactor 
event rate and Fourier spectra 

In this Section we investigate in detail how the inclusion of the detector energy resolution 
and/or the energy scale uncertainty affects the reactor Vf. event spectra, the Fourier spectra and 
hence the hierarchy sensitivity. For the detector's energy resolution we use the Gaussian form 
given in eq. (2.5). We consider an energy scale shrink/expansion both with and without energy 
dependence, which is parametrized in the form specified in eq. (2.6). As we have already indicated, 
the parameter a in eq. (2.6) is taken to be 1% (unless otherwise specified) for the energy independent 
case, and 1% of E (i.e. a linear dependence on energy) for the energy dependent case. 
3.1 Behaviour of the Event Rate Spectrum 

Figure 1 illustrates the changes of the reactor event rate spectrum in the case of Vf. oscillations when 
one varies the energy resolution of the detector. This is done for both the normal and inverted 
hierarchies, without including the effects of the energy scale shift. The spectrum plotted in Figure 1 
is the normalized to 1 reactor v^, event rate spectrum: 

/(Vi^^'") = 7(i7#r^^^ ' (3-1) 

\^ / ^TTL )rr>i'>-> 



where {L/E^)min = 5000 Km/GeV, {L/Em)max = 32000 Km/GeV, and N{L/Em) is given by 
eq. (2.7). Figures (a), (b) and (c) show the spectrum f{L/Em) without energy smearing {i.e. 
assuming perfect detector energy resolution), with a realistic smearing of 3% and with a large 
smearing of 20%, respectively. This and the subsequent event rate spectrum figures are obtained 
for sin^ 2^13 = 0.1. The figures clearly show the effect of the energy resolution: the spectrum is 
slightly "flattened" towards the higher values of L/Em in the case of resolution of 3% as compared 
to the unsmeared spectrum; it is smeared throughout and the hierarchy sensitivity is completely 
lost over almost the entire L/E range if the detector's energy resolution is as poor as 20%. 

Figs. 2 and 3 show the behaviour of the reactor i^g event rate spectrum when the detector 
resolution and/or the energy scale uncertainty are taken into account. 

In Figure 2, the spectrum with an energy smearing of 3% and an energy-independent expand/shrink 
is plotted, for both the cases of an expansion in energy scale, corresponding to a = 1%,6 = 0.01 
MeV, and a shrink in energy scale, corresponding to a = —1%, b = —0.01 MeV. The event spectra 
are seen to shift to the left and to the right, respectively. In Figure 3 we plot the same spectra 



®The inclusion of the current uncertainty in 613 (sin'^ 613 <0.05) in the analysis increases the quoted errors by 
(1-3)% to approximately 9% (12%) [59]. 
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for energy-dependent expansion and shrink. The displacements in the spectra are seen to be 
larger in this case, and for this value of the expansion/shrink it leads to an effective flipping of 
the maxima/minima in the spectrum, as compared to the spectrum without shrink/expansion. 
Note that the effect is the same for the normal and inverted hierarchies. The changes in the 
event spectrum can be shown to be identical with those without energy smearing for both energy- 
independent and energy-dependent scale shifts. 

3.2 Fourier analysis of the reactor event rate spectrum 

The Sine and Cosine Fourier Transforms of the reactor v^^ event rate spectrum are computed as a 
function of the "frequency" 5m^, varied in the range 2 x 10^'^ eV^ to 2.8 x 10^^ eV^, using the 
best-fit values lArrig]^! = 2.4 x 10~^ eV^ and Am^i = 7.6 x 10~^ eV^. The expressions for the 
Fourier Transforms used by us read [38]: 

max 

FCT{uj) = / f{L/E) cos(l^L/E) d(L/E) , (3.2) 

mm 
max 

FST{uj) = / f{L/E) sin(a;L/E) d(L/E) . (3.3) 

min 

Here oj = 2.54 x 6m'^ [c^'^li where 6m? is in units of eV^, and L/E is in units of km/GeV. 

The values |Am|i| = 2.4 X 10-3 eV^ and Aml^ = 7.6 x 10"^ eV^ appear in the normalised 
reactor event rate spectrum f{L/E). Hence, in the Fourier spectrum there is modulation due 
to both these frequencies. The modulation due to Amg^^ occurs near = 2.4 X 10-3 eV^, while 
that due to Am^]^ occurs near 6m'^ = 7.6 x 10"^ eV^. The values of the other neutrino oscillation 
parameters used in the calculations are sin^ 2^i2 = 0.87 and sin^ 2^13 = 0.1 (unless otherwise 
stated) . 
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Figure 2. (a) Reactor event rate vs L/Ei-^ for normal hierarchy, 3% energy resolution of the detector and an 
energy- independent uncertainty (shrink/expansion and shift) in the energy scale. The energy scale shift is performed 
on the neutrino energy Em after taking smearing into account, (b) The same as (a) for inverted hierarchy. 



According to [38], the main features in the FCT and FST spectra that ahow to distinguish 
between the two types of neutrino mass spectrum are: 

(a) In the FCT spectrum, {RV — LV) has opposite signs for the NH and IH spectra, where 
RV and LV are the amphtudes of the right and left "vaheys", i.e., of the minima located closest 
(i.e., immediately) to the right (RV) and to the left (LV) of the absolute modulation maximum, in 
the Fourier spectra. The right "valley" is deeper than the left "valley" for the NH spectrum, and 
vice versa for the IH spectrum. 

(b) In the FST spectrum, (P — V) has opposite signs for the NH and IH spectra, where P and V 
are the amplitudes of the absolute modulation maximum ( "peak" ) and of the absolute modulation 
minimum ("valley") in the two event rate spectra. The amplitude of the "peak" is bigger than the 
amplitude of the "valley" for the NH spectrum, and vice versa for the IH spectrum. 

The differences between the event rate spectra in the NH and IH cases can thus be quantified 
by the following two asymmetries [38]: 

for the FCT spectrum, and 

P -V 

PV=p^. (3.5) 

for the FST spectrum. The RL and PV asymmetry features discussed above are illustrated in 
Figure 4. 

We have analyzed the effects of the detector's energy resolution and energy scale uncertainty on 
the hierarchy-sensitive features of the FCT and FST spectra. Both the cases of energy-independent 
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Figure 3. (a) Reactor event rate vs L/Em for normal hierarchy, 3% energy resolution of the detector and an 
energy-dependent uncertainty (shrink/expansion and shift) in the energy scale. The energy scale shift is performed 
on the neutrino energy Em after taking smearing into account, (b) The same as (a) for inverted hierarchy. 



and energy-dependent energy scale uncertainty ("shrink/expansion") have been considered. The 
magnitude of the shrink (expansion) was assumed to be (-1%) ((+1%)). 

Our results are illustrated in Figs. 5 - 9, in which we show the FCT and FST spectra, 
corresponding to the NH and IH neutrino mass spectra, for different combinations of the de- 
tector's energy resolution and forms of the energy scale uncertainty. The figures are obtained for 
Am|]^(/ff) = — A?7i|2(A^-ff), sin^ 2^13 = 0.02, and the best-fit values of all other neutrino oscillation 
parameters. 

Comparing the respective curves in Figs. 5, 6, 7 and 8 demonstrates that with an energy- 
independent "shrink" performed on the measured energy (after smearing), the Fourier spectra get 
simply displaced to the left in all cases, with no change in the overall shape of the spectra. The 
shrink in the event versus energy spectrum leads to an "expansion" in the event versus L/Em 
spectrum, and as a consequence one obtains a given feature (maximum, minimum) at a smaller 
value of the oscillation frequency 5m? . This behaviour is accentuated if higher values of " shrink" are 
considered. This leads to an overall left shift in the Fourier (frequency) spectra. Since the sensitivity 
to the hierarchy in the Fourier spectra is related to the relative positions and the amplitudes of the 
maxima and minima of the spectra, the indicated changes do not affect results on the hierarchy 
sensitivity. In the case of an energy-dependent shrink, however, the change in the Fourier spectra 
is more complicated and the shape gets distorted, as the figures clearly show. This behaviour 
in both cases (energy-dependent or energy-independent shrink) is identical to the change in the 
corresponding spectra due only to an energy scale shift and no energy smearing, as observed by 
comparing Figs. 4, 5 and 7. The above comments hold true for both the FCT and FST spectra 
and for both the normal and inverted hierarchies. 

An energy- independent energy scale "expansion" of 1% gives a uniform right displacement to 
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Figure 4. (a) Fourier cosine transformed (FCT) reactor Ve event rate spectrum vs lirr? with power (y-axis) in 
arbitrary units, for sin'^ IQn = 0.02, normal hierarchy and inverted hierarchy, ideal energy resolution of the detector 
and no energy scale uncertainty, (b) Fourier sine transformed (FST) reactor Ve event rate spectrum vs &rr? with 
power (y-axis) in arbitrary units, for sin'^ 26^13 = 0.02, normal hierarchy and inverted hierarchy, ideal energy resolution 
of the detector and no energy scale uncertainty. 



the Fourier spectra, as expected. This is because the event versus L/Em spectrum shrinks with 
an expansion in the energy spectrum, leading to a shift of the Fourier spectral features to a higher 
frequency. With energy-dependent expansion of the measured energy scale, the spectrum shape is 
again changed (see Figure 9). 

As discussed above, the distinguishing feature of the NH and IH neutrino mass spectra in the 
FCT spectrum, according to [38], is the sign of the asymmetry RL defined in eq. (3.4): we have 
RL > {RV > LV) in the case of normal hierarchy and RL < {RV < LV) for the inverted 
hierarchy. In the case of the FST spectrum, it was proposed in [38] to distinguish between the 
normal and inverted hierarchy neutrino mass spectra by the sign of the asymmetry PV defined in 
eq. (3.5): one has PV > (P > V) in the NH case and PV < (P < V) if the IH spectrum is 
realized. On the basis of our analysis we can make the following observations. 

FCT spectrum. 

• Comparing Figure 4(a) (no smearing, no scale shift) with Figure 5(a) (3% smearing, no scale 
shift), the sign feature of the asymmetry RL = {RV — LV)/{RV + LV), distinguishing 
between the NH and IH cases, is seen to be retained with a smearing of 3%, with a somewhat 
reduced (increased) absolute magnitude of the asymmetry RL in the NH (IH) case (we find 
RL{NH) = 0.39, RL{IH) = -0.11 in Figure 4(a) and RL{NH) = 0.20, RL{IH) = -0.35 in 
Figure 5(a)). 

• Comparing Figure 4(a) with Figure 5(b) (no smearing, energy scale shift with energy-dependent 
shrink of 1%), the RL asymmetry feature distinguishing between the two hierarchies is no 
longer present with the inclusion of an energy-dependent energy scale shrink. Instead, the 
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absolute modulation maxima in the NH and IH spectra appear to be replaced by absolute 
modulation minima, while the adjacent valleys (minima) are replaced by adjacent peaks 
(maxima). We can define a quantity 

RP-LP , , 

where RP and LP are the amplitudes of the right and left peaks adjacent to the absolute 
modulation minima. This is seen to have a significant positive value for the NH spectrum, 
and a much smaller value close to zero for the IH spectrum. 

This behaviour can be explained on the basis of Figure 3 (the unsmeared reactor event 
spectrum as a function of L/E and with an energy-dependent scale shrink), and Figure 5(c), 
in which the FCT spectrum for NH (without smearing) is plotted for different values of the 
energy-dependent shrink factor, varying from 0.1% (a = 0.001 x Em in eq. (2.6)) to 1% 
(a = 0.01 X Em)- It may be observed that there is a gradual left-shift in the FCT spectrum 
with an increase in the shrink factor, as well as a change in its shape, with a progressive 
drop in the amplitudes of the maxima and an increase in the amplitudes of the minima in 
the modulation region. This shift leads to what looks like a fiipping of the maxima and 
minima when the shrink reaches a value of 1%. Note that this is not an actual inversion, 
but a feature caused by the left-shift and shape change of the spectrum. We have observed 
that in the corresponding event spectrum (Figure 3), there is a large right-shift due to the 
energy-dependent shrink, which leads to an effective inversion of the maxima and minima (as 
compared to the spectrum without shrink) for this value of the shrink factor. This is reflected 
in the left-shift and change in shape of the Fourier spectrum, which leads to an effective 
flipping of the modulation maxima and minima for a shrink of 1% or more (note that this is 
a continuous conversion as the value of the shrink increases). 

It may be pointed out that since this is a continuous change in the shape of the Fourier spec- 
trum, the RL asymmetry feature (eq. (3.4)) is retained till a value of the energy-dependent 
shrink upto about 0.3%, while the RLP asymmetry feature in the changed spectrum (eq. 
(3.6)) becomes effective at values of about 0.7% or larger. For intermediate values of the 
shrink factor, it is difficult to pinpoint a specific asymmetry feature. 

Comparing Figure 5(a) with Figure 6(a) (3% smearing, scale shift with energy-independent 
shrink of 1% performed after smearing), the energy-independent shrink is seen to leave the 
hierarchy-sensitive feature almost unchanged, as expected from the preceding discussion. 

Comparing Figure 5(a) with Figure 6(b) (3% smearing, scale shift with energy-dependent 
shrink of 1% performed after smearing), the energy-dependent shrink is again observed to fiip 
the modulation maxima to minima (as in Figure 5(b)), and the hierarchy-sensitive feature 
can again be defined as RLP, which in this case is still large and positive for the NH spectrum 
and has a small negative value for the IH spectrum (we have RLP{N H) = 0.40, RLP(IH) = 
—0.14 in Figure 6(b)). 



- 13 - 




0.002 0.0022 0.0024 0.0026 0.002 0.0022 0,0024 O0026 0.002 00022 0.0024 0.0026 

8m7eV' 8m7eV 8m7eV 

(a) (b) (c) 



Figure 5. (a) Fourier cosine transformed (FCT) reactor event rate spectrum vs &rr? with power (y-axis) in 
arbitrary units, for sin^ IQn ~ 0.02, normal hierarchy and inverted hierarchy, 3% energy resolution of the detector 
and no energy scale uncertainty, (b) Fourier cosine transformed (FCT) reactor event rate spectrum vs &rn} 
with power (y-axis) in arbitrary units, for sin^ IQn — 0.02, normal hierarchy and inverted hierarchy, ideal energy 
resolution of the detector and energy-dependent uncertainty (shrink and shift) in the energy scale, (c) FCT spectrum 
for sin^ 26^13 = 0.02, normal hierarchy, ideal energy resolution of the detector and different values of energy-dependent 
uncertainty in the energy scale. 

• Comparing Figure 6(a) and 6(b) with Figure 6(c) (3% smearing, scale shift with energy- 
dependent shrink of 1% and energy-independent shrink of 1% performed after smearing), it 
is seen that the resulting FCT spectrum is almost identical to the spectrum in Figure 6(b) 
obtained with only an energy-dependent shrink factor of 1%. This is because, as noted earlier, 
the energy-independent shrink factor leaves the spectrum almost unchanged (Figure 6(a)). 
Hence a combination of a linear and a non-linear scale uncertainty leads to the same effects 
as a non-linear scale uncertainty. A similar behaviour is observed in the FST spectrum. 

EST spectrum. 

• Comparing Figure 4(b) (no smearing, no scale shift) with Figure 7(a) (3% smearing, no scale 
shift), the hierarchy-sensitive feature of the asymmetry PV = {P — V) / (P + V) is seen to 
be retained. This feature is reflected in a large positive value of the asymmetry PV for 
the NH spectrum and a value close to zero for the IH spectrum (we have PV(NH) = 0.32, 
PV{IH) = 0.04 in Figure 4(b), and PV{NH) = 0.41, PV{IH) = 0.07 in Figure 7(a)). 

• Comparing Figure 4(b) with Figure 7(b) (no smearing, scale shift with energy-dependent 
shrink of 1%), we see that the PV asymmetry features corresponding to the NH and IH 
spectra are not present when the energy-dependent shrink is taken into account. Now the 
FST spectra show a behaviour similar to that of the FCT spectra with an energy-dependent 
shrink (Figure 5(b) and Figure 6(b)), i.e. the absolute modulation maxima in the NH and 
IH cases are effectively replaced by absolute modulation minima and the adjacent right and 
left (minima) valleys are replaced by right and left (maxima) peaks, RP and LP. Here the 



- 14 - 



quantity RLP is close to zero for the NH spectrum and is significantly different from zero 
and negative for the IH spectrum. This behaviour is explained in the same way as for the 
FCT spectrum: it also appears for values of the shrink of about 0.7% or larger, while the PV 
asymmetry feature is retained for very small values of the shrink of upto about 0.3%. 

• Comparing Figure 7(a) with Figure 8(a) (3% smearing, scale shift with energy-independent 
shrink of 1% performed after smearing), the PV asymmetry feature, distinguishing between 
the NH an IH spectra, remains largely unchanged, as expected. 

• Comparing Figure 7(a) with Figure 8(b) (3% smearing, scale shift with energy-dependent 
shrink of 1% performed after smearing), we see that features distinguishing between the NH 
and IH spectra in the case of a scale shift with an energy-dependent shrink of 1% are the same 
as in the unsmeared case discussed above (when comparing Figure 4(b) with Figure 7(b)). 

In the cases of energy-independent and energy-dependent energy scale expansion, the FCT and 
FST spectra exhibit the same features as those discussed above assuming energy-independent and 
energy-dependent energy scale shrink, respectively. For the FCT spectrum this is illustrated in Fig- 
ure 9. Comparing the curves with energy-dependent expansion in Figure 9(a) and 9(b) shows that 
the RLP asymmetry feature is present. With an increase in the magnitude of the shrink/expansion 
uncertainty, the asymmetry features discussed above survive with a reduced amplitude, getting 
washed out if the uncertainty exceeds ~ 5%. 

The above properties of the Fourier spectra indicate that it should be possible, in principle, 
to extract information about the type of the spectrum the neutrino masses obey from the features 
present in the spectra, although the nature of the hierarchy-dependent features is changed in the 
case of an energy-dependent energy scale shrink/expansion. 

3.3 The effect of the uncertainty of Am|^ on the Fourier spectra 

The effect of varying the atmospheric neutrino mass-squared difference over its error range, 
in general, causes a change in the magnitude of the hierarchy-sensitive asymmetry features of the 
Fourier spectra. More specifically we note the following. 

• FCT spectra. Comparing the NH and IH FCT spectra for different values of Am|^ over its 
uncertainty range, it can be seen that the RL asymmetry feature of the NH and IH spectra 
is completely changed in the case of an energy-dependent scale shrink/expansion. Instead, 
the RLP asymmetry feature discussed in the context of Figure 5(b) and Figure 6(b) appears. 
This feature is present throughout the considered range of Am^^, though the magnitude of 
the effect varies over the range. 

• FST spectra. Comparing the NH and IH FST spectra, it can be seen that the PV asym- 
metry feature in the spectra is changed in the case of the energy-dependent energy scale 
shrink/expansion, and the RLP asymmetry feature comes into play, as earlier noted in con- 
nection with Figure 7(b) and Figure 8(b). It is present with different amplitudes throughout 
the considered range of Am|]^. 
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Figure 6. (a) Fourier cosine transformed (FCT) reactor event rate spectrum vs &rr? with power (y-axis) in 
arbitrary units, for sin^ 2913 ~ 0.02, normal hierarchy and inverted hierarchy, 3% energy resolution of the detector 
and energy-independent uncertainty (shrink and shift) in the energy scale. The energy scale shift is performed on the 
neutrino energy Em after taking smearing into account, (b) The same as in (a), but for energy-dependent uncertainty 
(shrink and shift) in the energy scale, (c) The same as in (a) and (b), but for a combination of an energy-dependent 
and energy-independent uncertainty (shrink and shift) in the energy scale. 



4 x^- Analysis of the sensitivity to the type of the neutrino mass spectrum 

In the present Section we perform a full x^-analysis of the sensitivity to the type of the neutrino 
mass spectrum of a "measured" reactor Vf. spectrum. This allows us to take into account in a 
systematic way the uncertainties in the knowledge of |Am^tmli ^i3i ^'^iii ^12) the uncertainty 
in the energy scale, the systematic and geo-neutrino uncertainties, as well as the effects of the 
detector energy resolution. As is well known, the uncertainties in the values of |Am^^j^| and ^13, 
in particular, play a crucial role in the sensitivity to the neutrino mass hierarchy. 

We perform a binned x'^ analysis which involves an optimization in binning, a marginalization 
over the relevant neutrino oscillation parameters, and incorporation of systematic errors by the 
method of pulls. We find that an energy scale shrink/expansion and/or shift at the level of ~ 
1%, even when energy-dependent, does not affect the sensitivity to the hierarchy, and that the 
inclusion of the systematic and geo-neutrino flux uncertainties has only a minimal effect on the 
sensitivity of interest. We present results for different values of sin^ ^13, the detector exposure and 
the energy resolution. A prior term is added to the sensitivity to take into account information 
from other experiments on parameter uncertainties, and it is shown that if the present error ranges 
are considered, this external information leads to only a slight improvement in the results. 

In order to compute the hierarchy sensitivity by the x^-method, it is necessary to have binned 
event data. For a set of "experimental" (observed) events Ne^ii) and "theoretical" (predicted) 
events iVj/j(i), the standard Gaussian definition of the least squares sum of binned data reads: 
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Figure 7. (a) Fourier sine transformed (FST) reactor v^. event rate spectrum vs &rn^ with power (y-axis) in 
arbitrary units, for sin^ 2^13 = 0.02, normal hierarchy and inverted hierarchy, 3% energy resolution of the detector 
and no energy scale uncertainty, (b) Fourier sine transformed (FST) reactor Ve event rate spectrum vs &rr? with 
power (y-axis) in arbitrary units, for sin'^ 26^13 = 0.02, normal hierarchy and inverted hierarchy, for ideal energy 
resolution of the detector and energy-dependent uncertainty (shrink and shift) in the energy scale. 



where only the statistical error Ostat = \/ ^ex{i) is taken into account, and i denotes the bin label. 
We simulate the "experimental" spectrum Nex for a fixed "test" or "true" hierarchy (performed 
with a normal hierarchy unless otherwise specified; the difference in results is minimal). All other 
parameters are also kept fixed at a set of "test" values in N^x- The theoretical spectrum N^f^ is then 
generated with the ot/ier hierarchy, called the "wrong" hierarchy. The thus obtained determines 
the confidence level at which the "wrong" hierarchy can be excluded (i.e., the "x^ sensitivity") given 
the "true" hierarchy, the set of values of all other parameters used and the given values of errors, 
uncertainties, detector resolution, exposure, etc. 

Errors other than the astat, fike the fiux and geo-neutrino uncertainties and systematic errors, 
can be included using the method of pulls. Also, a comprehensive analysis requires a marginal- 
ization over the uncertainties in the neutrino oscillation parameters, which can be done by varying 
the parameters in the theoretical spectrum N^^ and choosing the minimum value of after taking 
into account this variation. 

Optimization of bin number. Figure 10 shows the behaviour of the sensitivity with an 
increase in the bin number. We plot in the figure the values of x^ with fixed neutrino parameters for 
an exposure of 200 kT GW yr, sin^ 2(9i3 = 0.05, A-siiNH) = 0.0024, A^iilH) = -A3i{NH) + A21 
and a detector resolution of 3%, for different numbers of L/E bins in the range L/E = 5 — 32 
Km/MeV. The sensitivity is seen to improve dramatically with an improvement in the fineness of 
binning. However, the maximum bin number that can be used is restricted by the energy resolution 
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of the detector. Hence, it becomes important to optimize the number of bins and choose a binning 
which is fine enough to give the best possible sensitivity while being consistent with the detector 
resolution. 

In general, the bin width can be chosen to be of the same order as the resolution width, 
but not significantly smaller. Here, an energy resolution of 3% would mean a resolution width of 
0.03 X \/ Ems , or approximately 0.03 - 0.1 MeV, over the given energy range of ii^ = 1.8 to 12 MeV. 
Hence we can choose to take approximately 10.2/0.07 = 145 bins in this energy range. Therefore, 
we consider a 150-bin analysis. The no-oscillation unbinned reactor event spectrum is used to 
generate a binned spectrum of events (the product of the no-oscillation event spectrum and the 
oscillation probability) in L/E bins of width 0.18 Km/MeV, i.e. 150 bins in the given L/E range of 
5-32 Km/MeV. The simulated "predicted" spectra are then used to calculate the sensitivity. 

Figs. 11 and 12 show the 150-bin event spectrum for both the normal and inverted hierarchies, 
with or without energy smearing and energy scale shift, using the no-oscillation spectrum as the 
unbinned data. The figures are obtained for sin^ 2^13 = 0.05 and a detector exposure of 200 kT 
GW yr. It can be seen that the NH and IH spectra show small differences through a greater part 
of the L/E range, which in a analysis can give a significant result since the procedure adds up 
the contributions from all the bins. A smearing of 3% washes out the sensitivity in part of the L/E 
range, as expected. The energy scale shift/shrink is seen to affect both the NH and the IH spectra 
identically. 

4.1 Parameter marginalization 

For a realistic analysis, one needs to take into account the ranges of uncertainty of the neutrino 
oscillation parameters, since they are not known to infinite precision. In order to do this, the 
values of the parameters (ideally all the neutrino parameters) are fixed at certain input ("true") 
values in the "observed" event spectrum N^xii) and varied over their present error ranges while 
computing the "theoretical" event spectrum Nthii), subsequently choosing the minimum value of 
after including a full variation. 

Practically, since the solar neutrino parameters 612 and Amg^ are already measured with 
a relatively high precision and the dependence of the oscillation probability on their variation is 
rather weak, it usually suffices to marginalize over the parameters ^13 and [Amg^l. We have checked 
that a marginalization over 612 and ^m^i over their present 3a ranges (sin^ 612 = 0.27 — 0.38, 
Am2]^ = 7.0 X 10"^ — 8.3 x 10^^) does not affect the results. Also, the fineness of binning in 
the parameters being varied during the process of marginalization needs to be optimized, since 
taking a coarse binning may give inaccurate results due to missing the actual point of minimal x^j 
while making the binning more rigorous gives progressively improved results but also increases the 
computational time involved. 

We consider the following error ranges for the two marginalized parameters: i) IA31I is allowed 
to vary in the range 2.3 x 10~^ — 2.6 x 10~^ eV^, and ii) sin^ 2^13 is varied from 0.0 to 0.15. 
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Figure 8. (a) Fourier sine transformed (FST) reactor Ve event rate spectrum vs 8rr? with power (y-axis) in arbitrary 
units, for sin^ 26*13 ~ 0.02, normal hierarchy and inverted hierarchy, for 3% energy resolution of the detector and 
energy-independent uncertainty (shrink and shift) in the energy scale. The energy scale shift is performed on the 
neutrino energy Em after taking smearing into account, (b) The same as in a, but for energy-dependent uncertainty 
(shrink and shift) in the energy scale. 



4.2 The precision on t^rr?^^^ and its effect on the hierarchy sensitivity 

When an experiment determines the atmospheric mass-squared difference, assuming that it does 
not also simultaneously determine the hierarchy, the question arises of what exactly it measures. 
We know that by definition, when the hierarchy is normal, the magnitude of Amlj^ is greater than 
that of Am|2, since the third mass state lies above the states 1 and 2, while in the case of an 
inverted hierarchy, Am^j is greater in magnitude than Am|]^, since the third state lies below the 
first two. So, if the experiment measuring the mass-squared difference does not know the hierarchy, 
it is not possible for it to measure the quantity |Am|^| or lAm^gl- We can reasonably assume 
that it measures something in between, or an effective Am^tm which is blind to the hierarchy, i.e. 
I Am^^-jjj ( A^i? ) I = |Am^tjjj(/-ff)|. This is, in general, a linear combination of Am|;^ and Am|2, i-e. 

Am^,^ = cAmii + dAmis , (4.2) 

where c and d can vary from to 1 and c -|- d = 1. 

Now when we perform the analysis for the hierarchy sensitivity, we require, as inputs 
from some experimental measurement, the range of uncertainty in the atmospheric mass-squared 
difference, as well as the values of Amgj^ and Am|2 for both the normal and the inverted hierarchies, 
when computing the survival probability Pge in the two cases (the probability is the only neutrino 
parameter-dependent part in the event spectra Nf.^ and Nt^). Hence we need to know how the 
magnitudes of Arrig^ and Am32 are related for the two hierarchies. From the definition of the 
measured Am^^^^ and the fact that it is equal in magnitude for NH and IH, it can be derived that 
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Figure 9. (a) Fourier cosine transformed (FCT) reactor i/g event rate spectrum vs 5m^ with power (y-axis) in 
arbitrary units, for sin'^ 26^13 = 0.02, normal hierarchy, 3% energy resolution of the detector and for both energy- 
dependent and energy-independent uncertainty (expansion and shift) in the energy scale. The energy scale shift is 
performed on the neutrino energy Em after taking smearing into account, (b) The same as (a) for inverted hierarchy. 



the following relations hold: 

\Aml^{IH)\ = Aml^{NH) - 2dAra\^ , 

I Amis {IH) I = Amia (NH) + 2cAmii , (4.3) 

where c and d can vary from to 1. In other words, the magnitude of Am|^ i^H) (as derived from the 
measured mass-squared difference) can vary from anywhere between Am'^i[NH) to Am^i^N H) — 
2Am2i, while the magnitude of Am'^2im) can be anywhere between Aml^iNH) to Aml2{NH) + 
2Am|i. 

In some cases (for specific experiments and measurements localized in specific regions of L/E) 
it is possible to pinpoint the exact linear combination being measured, since the relevant 3-flavour 
probability expressions may be reducible (with certain approximations) to effective 2-flavour forms 
which then define an effective mass-squared difference as the argument [66].^ In our analysis, we 
assume the most general case of an input from an experiment where an unknown linear combination 
is being measured. 

The hierarchy sensitivity depends on the difference between the survival probability Pgg for 
the two hierarchies, since the function is an artefact of this probability difference, averaged over 
L/E bins. For different values of the baseline L [i.e. different ranges of L/E), the Pge expression 

^In [66], an analysis of the possibility to determine the neutrino mass hierarchy is performed using specific val- 
ues of the constants c and d in eq. (4.2) (c = cos'^Si2, d — sin^&i2), which are derived in the approximation 
of Am|il//4i5 << 1. For the range of L/E considered by us we have Am2i-L/4i5 ~ 1, and thus the indicated 
approximation is not valid. 
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Figure 10. The hierarchy sensitivity (x'^)stat as a function of the number of L/E bins, for fixed neutrino oscillation 
parameters, sin^ 26i3 = 0.05 and detector's energy resolution of 3%, statistics of 200 kT GW yr, baseline of 60 Km 
and different L/E binnings in the range L/E = 5 — 32 Km/MeV. 

would give a minimized value of APgg = Pee{NH) — Peg{IH) for different values of Am|^(/i/) and 
Aml2{IH) in Pee{IH) (fixing a Aml^{NH) and Aml2{NH) in Pee{NH)). In general, the minimum 
of APgg would occur for a point \Aml^{IH)\ < Aml^{NH) and \Aml2{IH)\ > Aml^iNH), for the 
same reason as discussed above - this is how they are related in nature. So when performing the 
analysis, in addition to marginalizing over the error range in Am^^j^ (and hence in both Am'^-^^{NH) 
and Am^^{IH)), the possible variation in | Am|^ (/i? ) | relative to Am'^^{NH) as defined by eq. (4.3) 
also has to be taken into account. 

Thus, \Amli{IH)\th in the Nth spectrum is varied from Amli{NH) to Amli{NH) — 2Aml^, 
i.e. 0.0024 to 0.002248 as well as over the error range of |Am^^jj^| (which is at present 0.0021 
- 0.0028 at 3(t). Extending the range of marginalization does not change our results. What we 
need to check is the value of the minimum obtained during this variation, at which point of 
\Am2i{IH)\ it occurs, and whether it is zero or negligibly small at any point in this range. It is 
found that (for the true value sin^ 2^13 = 0.05 and a detector resolution of 4%, 200 kT GW yr 
exposure, and with a marginalization over ^13), the minimum is about 2, and occurs at about 
\Am'^-^^{IH)\th = 0.002387, as can be seen in Figure 13, which shows the values of (with the 
above specifications) as a function of the magnitude of Am'^i in the theoretical spectrum, choosing 
the hierarchy to be normal in N^x and normal (dashed curve) or inverted (solid curve) in Nth- 

This verifies that for the hierarchy sensitivity arising from the survival probability Pgg, in 
this L/E range, the x^ never vanishes at any point of \Am'^i{IH)\th, whichever experiment it may 
be derived from. So, regardless of the precision of Am^^j^, there will be some non-zero hierarchy 
sensitivity given by this x^, which would obviously be scaled up with higher detector exposures and 
improved with better detector resolution. At the level of the survival probability, this translates to 
the statement that the L/E spectra of Pgg for the normal and inverted hierarchies never become 
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L/E (Km/MeV) L/E (Km/MeV) 



(a) (b) 

Figure 11. (a) Reactor event spectrum binned in 150 L/Em bins for both the normal and inverted hierarchies, for 
sin'^ 2013 = 0.05, ideal energy resolution of the detector (no smearing) and no energy scale shift, (b) The same as 
(a) for 3 % energy resolution of the detector. 



completely identical for any pair of possible values of Am'^^{N H) and Am'^^(IH) ^. The point 
where they are most similar gives the minimum x^- 

4.3 Results 

Table 1 lists the values of the hierarchy sensitivity {x^)stat different values of 9is and the detector 
energy resolution, after a marginalization over the above parameter ranges, for an exposure of 200 
kT GW yr, when a 150-bin analysis is performed. These results are with only statistical errors (i.e. 
no systematic uncertainties) taken into account. The hierarchy sensitivity in a is related to the 1 
d.o.f. here by the expression a = \/~x^. 



Energy scale uncertainty. We have checked that including the energy scale shift and 
shrink/expansion in the event spectrum has no effect on the hierarchy sensitivity, either with an 
energy-dependent or energy-independent shrink/expansion. This is because, as observed in Figs. 2, 
3, 11 and 12, the effect of a scale shrink/expansion and shift is identical on the event spectra for 
the normal and inverted hierarchies, irrespective of the different kinds of changes it produces in 
the spectrum for a specific hierarchy. In other words, the shift or shape variations caused by an 
energy scaling do not lead to any change in the relative positions and behaviour of the NH and IH 
spectra. Hence the hierarchy sensitivity is unaffected. 

Priors. Prior experimental information regarding the other neutrino parameters can be in- 
cluded in the analysis in the form of "priors", defined as: 

2 ^ / |Am^tmr''""-|A^atml A ' , ^sin^ 2elr - sin^ 2013^ ' 

Xprior I „(\ 1^ ' 



<^(|Am^tml) ) \ C7(sin^20 



*This observation was also made in ref. [37]. 
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f 2\'min 
\X Jstat 


Energy resolution 








2% 


3% 


4% 


0.02 


0.55 


0.44 


0.33 


0.05 


3.50 


2.79 


2.11 



Table 1. Values of {x^)1tat marginalized over the parameters On and |Am3i| for two values of sin^ 26i^^ and three 
values of the detector energy resolution, for a detector exposure of 200 kT GW yr and a baseline of 60 Km. The 
values are obtained in an analysis using 150 L/E bins in the range 5-32 Km/MeV. 

Here |Am^^.j^| and sin^ 2^13 are the values of the marginahzed parameters in the A'j/, spectrum, 
I Am^tml*'^"'^ and sin^ 2^*3'^'^ are the values fixed in the N^x spectrum, and a{\Aatm\) and cj(sin^ 2^13) 
are the present la error ranges of the respective parameters, here taken to be cr(|Am^^j^|) = 
5%x lAm^^j^l*''™ and fj(sin^20i3) = 0.02. This quantity serves as a penalty for moving away 
from the "true" value of a parameter, since this would obviously worsen the fit with the (other) 
experiment (s) which measured the parameter. So adding the "prior" term to the and then 
performing the marginalization effectively minimizes the over our data as well as that of the 
other experiment(s) which measured the parameters. 

Table 2 lists the values of the hierarchy sensitivity [(x^) So,"] prior for different values of ^13 
and the detector energy resolution, after a marginalization over the above parameter ranges with 
priors taken into account, for the same values of detector exposure and event binning. There is 
a slight improvement in the results with the inclusion of priors. It may be noted here that if an 
improved la error of (T(|Am^^j^|) = l%x | Am^^-jj^l*™ in the atmospheric mass-squared difference 
is considered (which may be possible from future precision experiments), the improvement in the 
hierarchy sensitivity with the inclusion of the prior term is more pronounced. For example, the value 
of [{x'^)^^cIt]prior for sin^ 26^^'^ = 0.05 and a detector resolution of 4% (second row, last column in 
Table 2) becomes 2.6 in this case. Since jAm^^jj^j is likely to be determined with increasingly better 
precision before the hierarchy ambiguity is resolved, it may be useful to include prior information in 
this way from measurements of |Am^tjjj|, when studying the hierarchy sensitivity of an experiment. 

Detector exposure. In Table 3, we give the values of the hierarchy sensitivity [(x')™a"] for 
sin^ 20^3"'^ = 0.02, for 3 different values of the detector resolution and a scaling in the detector 
exposure. These results show the strong dependence of the sensitivity on the detector exposure, 
which is a function of the detector mass, power and time of running. In other words, the sensitivity 
is directly related to the statistics or total event number of the reactor experiment. Hence, a 
hierarchy sensitivity of > 1.5cj may be possible even for sin^ 29\^^'^ = 0.02 with an exposure of 1000 
kT GW yr and an energy resolution of 2%, and this would improve further with a higher detector 
mass/power. With a larger value, like sin^ 29^^'^ = 0.05, an exposure of 1000 kT GW yr may give 
a hierarchy sensitivity of > 3a even for an energy resolution of 4%. 

These results can be compared with the results for hierarchy sensitivity in [37], where the 
detector exposure (in kT GW yr) required to obtain a sensitivity of la or 66.8% C.L., is plotted as 
a function of the neutrino baseline or the energy resolution of the detector. The authors of [37] find 
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that for an energy resolution of 2%, for a baseline of 60 Km, sin^ 2^13 = 0.05 and best-fit values of 
other parameters, an exposure of about 220-230 kT GW yr will be required to obtain a sensitivity 
of la. Similar parameter values of the baseline, ^13, detector exposure and energy resolution give 
xitat ~ ^ sensitivity of 1.8a, in our analysis. 

Systematic errors. Apart from the uncertainties in the neutrino parameters, the systematic 
uncertainties related to the detector and geo-neutrinos also need to be included in a realistic anal- 
ysis. In this case, we consider 5 sources of systematic uncertainties (3 from the detector and 2 from 
geo-neutrinos) [37], as mentioned earlier, for which the following values are taken: 

• The efficiency error, 2%. 

• The uncertainty in the estimation of the detector energy resolution, 8%. 

• The linear energy scale uncertainty, 1%. 

• The uncertainty in the total detectable terrestrial antineutrino flux, 10%. 

• The uncertainty in the ratio of from the decay of U-238 and Th-232, 10%. 

The last two errors may be quite large, but varying them to higher values has no significant 
effect on the results. 

We take into account the above uncertainties using the method of pulls (see, e.g., [65]). In this 
method, the inputs (quantities having systematic uncertainties) are allowed to deviate from their 
standard values in the computation of Nth{i)- If the jth input deviate from its standard value by 
(Tj^j, where a^ is the magnitude of the corresponding uncertainty, then the value of Nth{i) with the 
changed inputs is given by 

npuU 

Nthii) = Nth{i){std) + ckj > (4-4) 

j=i 

where Nth{i){std) is the theoretical rate for the i**^ bin, calculated with the standard values of the 
inputs and npull is the number of sources of uncertainty, which in our case is 5. The ^j's are called 
the "pull" variables and they determine the number of a's by which the jth input deviates from its 
standard value. In Eq.4.4, cj is the change in N^hii) when the j th input is changed by ctj (i.e. by 
1 standard deviation). The shifted event rate defines a modified which is then minimized with 
respect to the pull variables. 

Implementing this method with the error parameter values given above is found to have only a 
minimal effect on the hierarchy sensitivity. For example, the value of [{x'^)^at]prior for sin^ 29^^'^ = 
0.05 and a detector resolution of 4% (second row, last column in Table 2) changes only from 2.25 to 
2.26 with the inclusion of systematic uncertainties. Hence we conclude that the hierarchy sensitivity 
from a reactor antineutrino experiment is strongly dependent on the detector energy resolution, 
the exposure (statistics) and the value of the parameter ^13, but has a weak dependence on the 
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(a) (b) 

Figure 12. (a) Reactor event spectrum binned in 150 L/Em bins for both the normal and inverted hierarchies, 
for sin'^ 2^13 — 0.05, for ideal energy resolution of the detector (no smearing) and an energy-dependent uncertainty 
(shrink/expansion and shift) in the energy scale, (b) The same as (a) for 3 % energy resolution of the detector. 



iiX )stat]prior 


Energy resolution 








2% 


3% 


4% 


0.02 


0.57 


0.46 


0.37 


0.05 


3.64 


2.93 


2.25 



Table 2. Values of [(x'^)atat]prior marginalized over the parameters ^13 and |Am|i| with priors included, for 
sin^ 2^13"° = 0.02; 0.05 and three values of the detector's energy resolution. The baseline, detector exposure and 
event binning are the same as those used to obtain Table 1. 

values of the systematic errors of the detector, as long as they do not exceed ~ 10%, and on the 
flux uncertainty due to the geo- neutrinos. 

5 Conclusions 

In the present article we have studied the possibility to determine the type of neutrino mass 
spectrum, i.e., "the neutrino mass hierarchy", in a reactor experiment with a relatively large 
KamLAND-like detector and an optimal baseline of 60 Km. This possibility has been previously 
investigated in [34], and further in [35] using the x^-™ethod, and in [36-38] using the method of 
Fourier transforms of simulated data and the method of maximum likelihood analysis. Here we 
first analyzed systematically the Fourier Sine and Cosine Transforms (FST and FCT) of simulated 
reactor antineutrino data with reference to their specific neutrino mass hierarchy-dependent features 
discussed in [38]. In the second part of the study we performed a binned analysis of the sensitivity 
of the simulated data to the mass hierarchy. We considered a detector with a mass of the order of 
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f 2\min 
VA ) stat 


sin^ 2(9^3"^ = 0.02 






sin^ 261^3*^^ = 0.05 






Detector exposure, kT GW yr 


Energy resolution 














2% 


3% 


4% 


2% 


3% 


4% 


200 


0.55 


0.44 


0.33 


3.50 


2.79 


2.11 


400 


1.10 


0.88 


0.66 


7.0 


5.58 


4.22 


600 


1.65 


1.32 


0.98 


10.50 


8.37 


6.33 


800 


2.20 


1.75 


1.30 


14.0 


11.15 


8.40 


1000 


2.70 


2.15 


1.60 


17.20 


13.80 


10.50 



Table 3. Values of (x^) ^t"t marginalized over the parameters ^13 and |Am3ij for several different detector exposures 
(in kT GW yr), sin^ 2^13"° = 0.02; 0.05, three values of the detector's energy resolution and a baseline of 60 Km, 
obtained in an analysis using 150 L/E bins in the range 5-32 Km/MeV. Including priors in the analysis increases 
the sensitivity to the type of the neutrino mass spectrum. 



10 kT, similar to the one proposed for the Hanohano experiment [36], using a flux from a reactor 
having power of 5-10 GW and thus providing high statistical samples of ~ 10^ or more events. The 
threshold of the measured e"*" (i.e., visible) energy was set to Emsth = 1 MeV. We have considered 
values of detector's energy resolution a /Ems in the interval 2%/y/E^ — 4%/-v/SJ!iI; in a few cases 
larger values have been utilized for clarifying and illustrative purposes. 

The investigation of the neutrino mass hierarchy sensitive features of the FST and FCT spectra 
was performed, in particular, taking into account the possibility of an energy scale uncertainty in 
the form of scale shrink/expansion and shift. We have considered not only energy-independent, 
but also energy-dependent scale factors, more specifically, scale factors which depend linearly on 
the energy. Our findings can be summarized as follows. 

1. The hierarchy-sensitive features in both the FCT and FST spectra discussed in [38] are progres- 
sively reduced in magnitude with the worsening of the detector's energy resolution (i.e., with the 
increasing of a /Ems). 

2. An energy-independent energy scale uncertainty (shrink/expansion and shift), leaves these fea- 
tures substantially unchanged, since the shapes of the FST and FCT spectra suffer only sideways 
shifts. 



3. The asymmetry feature distinguishing between the two hierarchies discussed in [38] is no longer 
present with the inclusion of an energy-dependent energy scale shrink/expansion (compare, e.g.. 
Figure 4(a) with Figure 5(b)): the absolute modulation maxima in the cases of normal hierarchical 
(NH) and inverted hierarchical (IH) spectra are effectively replaced by absolute modulation minima 
for values of the shrink factor of about 0.7% or larger, while the adjacent valleys (minima) are 
replaced by adjacent peaks (maxima). We have defined the quantity 
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where RP and LP are the amphtudes of the right and left peaks adjacent to the absolute modulation 
minima. The asymmetry RLP has a significant positive value for the NH spectrum and a much 
smaller value close to zero for the IH spectrum. For smaller values of the energy-dependent shrink 
factor, there is a continuous left-shift and change in shape of the Fourier spectrum leading to a 
conversion from the RL or PV asymmetry feature to the RLP asymmetry feature. For values of 
the shrink factor between ~ 0.4% — 0.6%, it is difficult to identify specific asymmetry feature. 

These properties of the Fourier spectra indicate that it should be possible, in principle, to 
extract information about the type of the spectrum the neutrino masses obey from the features 
present in the spectra, although the nature of the hierarchy-dependent features is changed in the 
case of an energy-dependent energy scale shrink/expansion. 

The effect of varying the atmospheric neutrino mass-squared difference Am'?^^^ over its error 
range, causes, in general, a change in the magnitude of the hierarchy-sensitive asymmetry features 
of the FST and FCT spectra without eliminating them completely. 

We have performed also a statistical study of the possible sensitivity of such a reactor an- 
tineutrino experiment to the type of the neutrino mass spectrum. We adopted the method of a 
binned analysis, which offers the advantages of a straightforward incorporation of i) parameter 
uncertainties, ii) detector characteristics like the energy resolution and energy scale uncertainty, 
iii) systematic errors (for which we use the method of pulls), iv) an optimized binning of data to 
reach the maximum possible sensitivity while being consistent with the detector resolution, and v) 
the inclusion of external information on the neutrino parameters using priors. The survey was 
performed using an exposure of 200 - 1000 kT GW yr, and the results were presented for different 
values of the detector resolution, detector exposure, and the true value of 6*13, with a marginal- 
ization over all neutrino parameters. The bin number was optimized at 150. The true spectrum 
was assumed to be with normal ordering (NH). The results of this analysis can be summarized as 
follows. 

The hierarchy sensitivity depends strongly on the the true value of ^13, the energy resolution 
of the detector, the detector exposure and on the binning of the spectrum data. It improves 
dramatically with an increase in ^^3^^'^, increases linearly with the exposure (due to the increase in 
statistics), and falls significantly with worsening resolution. For example, (x^)Sa? "wrong" 
hierarchy improves from 0.55 for = 0.02, an energy resolution of 2% and a detector 

exposure of 200 kT GW yr (corresponding to a hierarchy sensitivity of less than la), to 3.5 (a 
sensitivity of 1. 8a) for sin^ 261^3'^'= = 0.05 for the same values of the resolution and exposure. With 
an exposure of 1000 kT GW yr and the same values of the resolution and ^i™*', it increases to 2.7 
{1.6a). On the other hand, if the energy resolution has 3, value of 3%, the )^ai 

falls to 0.44 for 

the same values of ^13^'^ and exposure, and a significant sensitivity (> 2a) can be achieved only if 
the exposure is scaled up to higher than 1000 kT GW yr. 

A marginalization over the error ranges of the parameters Am^^m ^ significant 

effect in the case of Am^^j^, and a mild effect in the case of ^13. Varying the solar parameters 
Am|j^ and 612 within their 3a ranges leaves the results essentially unchanged. Moreover, since the 
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currently measured value of the atmospheric neutrino mass-squared difference Am^tm is, in general, 
in between Amg^ and Amgg, it is important to take into account the possible range of Am^-^^{IH) 
and Am32(/-ff) with respect to the assumed true values of Am'^^{NH) and Am'22{^H), when 
computing the sensitivity. It is found that since the v'e survival probability P^^iL/E) never 
becomes identical for any pair of possible values of Am'^-^^{NH) and Am^^{IH) within the L/E 
range relevant for our analysis, the marginalized remains non-zero over the entire allowed range 
of Am'^i{IH), and, if 9i3 is sufficiently large, it can assume significant values for the exposures and 
energy resolutions considered. 

The sensitivity does not depend significantly on the energy scale uncertainty (up to a value 
of about 5%), even in the case of a scale uncertainty factor which depends linearly on the energy. 
This is due to the fact that the scale shift affects the event spectra in the cases of the NH and IH 
neutrino mass spectra in the same way. We found also that the effect of systematic errors (assumed 
to be smaller than ~ 10%) and geo-neutrino flux uncertainties is insignificant (less than 1%). 

The number of L/E bins in the analysis strongly influences the value for the "wrong" 
hierarchy. The value of increases three-fold when the bin number is increased from 40 to 
150. However, the allowed bin number is constrained by the detector's energy resolution and the 
requirement that the bin width is not smaller than the resolution width. Hence, the optimization 
of binning is important. Also, increasing the threshold of the visible energy in the analysis from 
Evisth = 1-0 MeV to Emsth = 1-8 MeV (i.e. putting a higher cut-off of 2.6 MeV on the i7e energy 
spectrum) significantly worsens the sensitivity, because of the corresponding loss of statistics. If, 
for instance, we choose Evisth = 1-8 MeV and perform an analysis with 25 L/E bins, we obtain 
a poor (x^)Sa? = 0-8 even for as high a value of ^13 as sin^20j3^'^ = 0.1, an exposure of 200 kT 
GW yr and an energy resolution of 3%. With E^i^th = 1-0 MeV, 150 L/E bins, sin^lOf^" = 0.05 
and the same values of exposure and energy resolution, we get {x'^)stai — 2-8. The worsening of 
the hierarchy sensitivity with the increase of Eyigth to 1.8 MeV occurs in spite of the fact that the 
increased threshold excludes the contribution to the signal due to geo- neutrinos. This is because 
the total statistics has a much more dramatic effect on the hierarchy sensitivity: in the case of a 
sufficiently large statistics the geo-neutrino uncertainties play essentially a negligible role. 

The addition of external information in the form of priors has only a minor effect on the sensi- 
tivity (~ 5%) with the present la error range of 5% in | Am^^^^j. The contribution of priors becomes 
important if a prospective precision of 1% on lAm^^ml is considered, leading to an improvement of 
~20%. For example, for a |Am^^jj^| error range of 5%, sin^ 2d^i'^^ = 0.05 and a detector resolution of 
4%, the value of [{x^)'^^^]prior = 2.25 (as compared to (x^)Sat = 2.11 without priors), but with an 
improved |Am^^.j^| error range of 1% (which may be possible from future precision experiments), 
the value of [{x^)'^^(^]prior = 2.6. Since the neutrino parameters are likely to be measured with 
improved precision before the neutrino mass hierarchy is determined, it is useful to include prior 
information from other experiments in this way. 

Our results show that if sin^ 2^13 is sufficiently large, sin^ 2^13 ^ 0.02, it would be possible to 
get a significant information on, or even determine, the type of neutrino mass spectrum (i.e., the 
neutrino mass hierarchy) in a high statistics experiment with reactor with a baseline of 60 km. 
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Figure 13. The function {}(^)stat, marginalized over ^13, versus |Am3i| for sin^ 26^3"'' — 0.05 and a detector energy 
resolution of 4%, 200 kT GW yr detector exposure and 60 Km baseline. The figure is obtained from a 150-bin 
analysis in the range L/E = 5 — 32 Km/MeV. The true hierarchy is chosen to be normal. The dashed (solid) curve 
corresponds to the NH spectrum ("wrong" IH spectrum). 

using a relatively large KamLAND-like detector of mass ~ 10 kT, having an energy resolution of 
a /Ems ~ (2%/-v/ Eyis — 4% / t/ Eyis ) and an exposure of at least 200 kT GW yr. These requirements 
on the set-up are very challenging, but not impossible to realize. 
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